Information trimming: Sufficient statistics, mutual information, and predictability from effective channel states
نویسندگان
چکیده
منابع مشابه
Information trimming: Sufficient statistics, mutual information, and predictability from effective channel states.
One of the most basic characterizations of the relationship between two random variables, X and Y, is the value of their mutual information. Unfortunately, calculating it analytically and estimating it empirically are often stymied by the extremely large dimension of the variables. One might hope to replace such a high-dimensional variable by a smaller one that preserves its relationship with t...
متن کاملTrimming the Independent Fat: Sufficient Statistics, Mutual Information, and Predictability from Effective Channel States
SFI Working Papers contain accounts of scienti5ic work of the author(s) and do not necessarily represent the views of the Santa Fe Institute. We accept papers intended for publication in peer-reviewed journals or proceedings volumes, but not papers that have already appeared in print. Except for papers by our external faculty, papers must be based on work done at SFI, inspired by an invited vis...
متن کاملInformation Theory: Data Compression, Channel Coding, Entropy, and Mutual Information
This report gives an insight about two major aspects of information theory, including data compression and channel coding. It discusses the simulations results obtained using MATLAB from the information theory view point. It also defines these aspects by using the definitions of entropy and mutual information which reflects the optimum data compression could be obtained and the ultimate transmi...
متن کاملClustering of a Number of Genes Affecting in Milk Production using Information Theory and Mutual Information
Information theory is a branch of mathematics. Information theory is used in genetic and bioinformatics analyses and can be used for many analyses related to the biological structures and sequences. Bio-computational grouping of genes facilitates genetic analysis, sequencing and structural-based analyses. In this study, after retrieving gene and exon DNA sequences affecting milk yield in dairy ...
متن کاملMulti-channel Mutual Information Using Scale Space
We propose a new voxel similarity measure which utilises local image structure as well intensity information. Gaussian scale space derivatives are used to provide the structural information. Each derivative is assigned to an information channel of higher dimensional form of normalised mutual information. We illustrate the behaviour of the measure for a simulated signal and 2D medical brain imag...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Physical Review E
سال: 2017
ISSN: 2470-0045,2470-0053
DOI: 10.1103/physreve.95.060102